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Pr&fnce 

The  term  "spectral  theorem"  comes  from  the  word  spectrum  which 
means  any  range  of  characteristics,  values,  activities,  etc.  Thus  a  spectral 
theorem  for  an  operator  describes  how  the  operator  is  determined  by  its 
spectrum.  A  spectral  theorem  is  the  single  most  powerful  technique  for 
describing  the  structure  of  an  operator  on  a  vector  space. 


rtje  JORDAN  nDrcdal  fDrcd 

f  DR  LINEAR  DpeRArDRS 


Introduction 

The  object  of  this  chapter  will  be  to  develop  a  simple 
representation  of  a  linear  operator  (or  linear  transformation)  on  a 
finite-dimensional  vector  space  over  an  algebraically  closed  field.  For 
computational  purposes,  this  representation  is  a  matrix. 

The  Jordan  Normal  (Canonical)  Form  of  a  matrix  gives  an  extremely 
simple  representation  of  a  linear  operator  on  a  complex  finite-dimensional 
vector  space.  (The  complex  vector  space  ensures  that  the  field  is 
algebraically  closed).  We  emphasize  that  the  discussion  is  limited  to 
finite-dimensional  spaces  since  there  is  no  analogue  for  the 
Infinite-dimensional  case.  By  studying  certain  invariants  of  the  linear 
operator  such  as  invariant  subspaces,  projections,  eigenvalues,  and 
eigenvectors,  we  shall  examine  how  a  specific  operator  is  determined. 
Based  on  this  determination,  a  special  basis  will  be  developed  for  the  given 
vector  space,  with  respect  to  which  the  matrix  of  the  operator  on  that 
vector  space  is  quite  simple.  This  matrix  will  be  the  Jordan  Normal  Form. 


ja>JTOM  Mif^*^^^^-    — f"e 


Some  basic  definitions 

Wp  will  firQt  flpfinp  sonT*  0^  ^h**  rnnrpntc  ne'^6*=i*5**'"ii  fnr  nnrtiiiinn 

our  objective. 

A  linear  operator  T :  U  — >  V,  where  U  and  V  are  vector  spaces  over  the 

same  scalar  field,  is  a  function  such  that 

i)T(x+H)=  T(x.)  +  T(t|)  forallx,  tjBU 
ii)  T  (ax)  =  a  T  (x)  for  all  x  e  U  and  scalars  a 

We  say  that  T  is  a  linear  operator  on  U  if  T ;  U  — >  U. 

A  basis  for  V  is  a  collection  of  vectors  {x^ ,  Xj, ...,  Xj^}  in  V  such  that 
i)  {x^ ,  X2, ...,  Xf,}  is  linearly  independent. 

i.e,  if  a^x^  +  0,2X2  +  ...  +  cK^'Si"  ^'  ^^^^  *^i  ~  0(2=  ■--  =  «^=  0 
ii)  {x,,^,  ■■■''\^  spans  V. 

The  range  space  of  T:  U  — >  W,  Rj,  is  defined  by 

Rj  =  {  y  I  y  e  V  and  y  =  T  (x)  for  some  x  e  U  } 
The  null  space  of  T:  U  — >  V,  Nj,  is  defined  by 

Nj=  {  X I  X  G  U  and  T  (x)  =  0  } 


The  matrix  representation  of  a  linear  operator 


A  linear  operator  is  most  conveniently  represented  as  a  matrix.  !t  is 

important  to  realise  that  while  a  linear  operator  ie  a  basis-free  object,  a 
particular  matrix  representation  of  T  .  U  — >  V,  depends  on  the  choice  of 
bases  for  U  and  V.  Thus  if  we  know  the  effect  of  T  on  the  basis  vectors,  we 
can  determine  its  effect  on  any  vector. 

It  is  known  that  any  vector  space  over  the  field  IR  with  basis 
X  =  {x^,  X2,  ..-,  Xj,}  is  isomorphic  to  ]R"    with  the  isomorphism  being  a 
mapping  into  a  column  vector  as  follows: 

*:      PiX,+  p2^2+     -+Pn'^n         ">  '     Pi 

P2 


Pn   J 


In  order  to  simplify  notation,  we  will  henceforth  identify  the  vector 
p,x,+p2'<2+-  -+Pn>«h  with  the  column  vector  given  above. 


Theorem  i 

A  linear  operator  T:  U— >  V  is  uniquely  represented  by  a  matrix  Aj, 

where  Aj-  is  determined  by  T  and  the  choice  of  bases  for  both  U  and  V. 
Proof 

Assume  X  =  {x, ,  y^,  ...,  ^}  and  y  =  {tji ,  ^,  ...,  %,)  are  bases  for  U  and 
V  respectively. 


HwA^iUlj  >A^HiJ    ^    -':    mi.lAiiih.c. 


•  oqfii, 


Since  y  is  a  basis  for  V  and  givenTCx-Je  V,  there  exists  scalars(x^=  such 
that 

m 
i=  1 

For  -K  G  U,  since  X  is  a  basis  for  U,  there  exist  scalers  p:  such  that 


X  =  2     P  i  5^  j 


3  =  1 


Then  since  T  is  linear 


n  m 


T(x)  =    T(2   pjXj)  =      2   p|  (T(x^))  =       2  pj  (  2  a^^y^) 
j  =  l  j=l  i=l        i.=  i 


(2     p^ai^)l^,+  (2     Pj<X2j)y2+  ■  +  <2    Pj<^mj)V. 


TW  = 


2    pja,j 


L  ,=> 


Pj^mj 


We  emphasize  that  when  summed  over  j=  1,2, ...,  n  ,  the  resulting  vector 
T  (x)  is  obtained  with  respect  to  both  the  bases  X  and  y . 


We  now  expand  the  above  column  vector  representation  of  T(x)  as  follows: 


T(xJ    = 


Pl<^21+ +  Pn^2n 


For  computational  purposes  the  vector  T(x)  may  be  expressed  as  the 
following  matrix  product: 


T(x)  = 


"-11  ^y2 


21 


(X 


a 


I-  <^  ml   *^  m2 


(X 


In 

"Pi    1 

2n 

P2 

mn_ 

-Pn. 

But 


p  ,  1  is  the  vector  x  with  respect  to  the  basis  X 

92 


LPn, 


Therefore  T(x)  =  a^x 


where  ylj  =  (a^J  is  the  m  x  n  matrix  with  a^z  as  the  entry  in  the  i-th  row 
and  j-th  column  of  the  matrix.  We  aqain  emphasize  that  a^  is  determined 
by  both  the  operator  and  the  choice  of  bases  ■ 


Bases  for  the  matrix  of  a  linear  operator 

As  st8tGd  at  the  outset  In  develo^in'^  the  Jordan  form  of  9  matrix 
our  object  is  to  identify  the  "preferred  basis"  of  a  matrix.  From  now  on,  we 
will  restrict  out  attention  to  the  case  where  T  is  a  linear  operator  on  V. 
Thus  the  matrix  Ar^=  (a^=)  is  a  square  array.  Identifying  the  preferred  basis 
is  equivalent  to  identifying  the  preferred  form  of  the  matrix  Aj-. 

We  will  first  consider  how  the  matrix  of  an  operator  changes  with  a 
change  of  basis. 

Proposition 

Let  T be  a  linear  operator  on  the  n-dimensional  vector  space  V  and 

n  ft 

letX={xJi^=j  and  y={yi}i=i  be  two  different  bases  for  V.  If 
^T,x=  ^*^ii^  is  ^1^^  matrix  of  T  with  respect  to  X  , 
and       %,L)"  ^PiP  is  ^^^  matrix  of  T  with  respect  to  I) , 
then  there  is  a  matrix  C  such  that  CAp5^=  fij-u^ 

Proof 

For  each  ^  e  X ,  there  are  scalers  ^^.   i=  1.2 n.  such  that 


L  =  1 

n 

Let     ijij=  2  cj^jx^  give  the  change  of  coordinates  from y  to X.  Then 
I  =  1 


flu:Afl3qp 


n  n  ft     n 

i=  1  i=  1  i=  1    L=  1 


Likewise  for  each  i^  e  y  ,  there  are  scalers  p^. ,   i  =  \  ,2, ...  ,n,  such  that 

n  n      n 

i=l         i=l   fc,=  l 

Therefore  by  equating  the  expressions  for  T(i^J  we  get, 

n   n  n   n 


Let  C  be  the  matrix  whose  ij-th  entry  is  c  j^, .  Then  we  obtain  the  equation 

If  Cislnvertible,  then  *V,x  =   ^'^^.y*^ 

W.  fi.  Although  we  shall  not  prove  it  here,  it  is  true  that  C  is  invertible  in 
the  case  where  *^^and  flk|-»  are  both  nnatrix  representations  of  T.  In  fact, 

matrices  A  and  fl  both  represent  the  same  linear  operator  with  respect  to 
different  bases,  if  and  only  if  there  is  an  invertible  matrix  C  with 
^  =  C-l  fi  C 

A  matrix  A  is  said  to  be  similar  to  a  matrix  fl  if  and  only  If  there  is 
an  invertible  matrix  C  such  that  A=  C^  fl  C .  Thus  in  our  discussion  above. 


.ti  .:••: 


Ap  jt  is  similar  to  ftj-  y .  If  *V.x  i^  similar  to  yet  another  matrix  D,  then  D 
is  simply  the  matrix  of  T  with  respect  to  another  basis. 


The  diagonal  forh 

The  most  convenient  form  of  a  matrix  representation  of  a  linear 
operator  would  be  if  the  matrix  were  in  diagonal  form.  We  will  now  give  an 
example  where  the  matrix  can  be  put  into  diagonal  form  and  an  example 
where  it  is  impossible  to  do  so. 

Exatnpte  1 

Let  T:  1R2  — >  1R2  be  defined  by  its  operation  on  the  basis 
X  =  {(1 ,0)X0, 1 )}  as  follows  :  T (1 ,0)  — >  (1 ,3)  and  T (0 J )  — >  (2,2).  Then 


^: 


%    = 


1        2 
3       2 


In  order  to  show  that  T  has  a  diagonal  matrix  representation,  we  must  find  a 
diagonal  matrix  D  such  that  Aj^  C  =  C  D .  Consider 


M= 


Then  by  taking  the  matrix  product  and  equating  the  corresponding  matrix 


i-.'    ^  -L-iiiUJ. 


a  IHI 


entries  we  get         a  +  2c  =  A^a    and     3a  +  2c  =  Xf 

Then      2a  =  Aj  (c  -  a).     Thus    Aj  =  2a  /  (c  -  a). 

Similarly,  we  find  that  X^  =   2b  /  (d  -  b). 

If  we  let  a  =  2,  b  =  1 ,  c  =  1 ,  and  d  =  3,  then  det  C  *  0  and  C  is  an  inverlible 


matrix.  Also  D    = 


0       1 


Thus  T has  a  diagonal  matrix  representation. 

Let  T:  ]R2  -->  ]R2  be  the  rotation  of  the  basis  vectors 
X={(1,0),(0,1)}  through  an  angle  of  Tf/4  in  the  counter-clockwise  direction. 
Then 

T(1,0)  — >    (  Cos  fl/4.  Sin  fl/4)    =  (   I//2,  I//2) 
T(OJ)  — >    (-Sin  7^/4,  Cos  fl/4)    =  (-I//2J//2) 


Thus 

2        ri//2     -1//2 
^,%  =  i 

i  1//2      1//2  J 


As  in  Example  1 ,  we  will  try  to  find  matrices  C  and  D  such  that  Aj.^  C  =  C  D 
where  C  is  an  invert! ble  matrix  and  D  is  diagonal. 


10 


1//2     -\N2 
1//2        1//2 


r^ 


0 


By  equating  corresponding  matrix  entries  as  before,  we  get 

a  -  c  =  /2  a  Aj       and       a  +  c  =  /2  c  Aj 
Then  (a  -  c)/(a  +  c)  =  a/c       and       3^  +  0^  =  0 

Thus  a  =  0       and        c  =  0 

But  then  det  C=  0.  Hence  C  is  not  Invertlble.  Thus  there  Is  no  diagonal  matrix 
representation  of  T. 


The  direct  sum  decomposition  of  a  vector  space  : 
Invariant  subspaces  and  the 
reduction  of  a  linear  operator 

Since  the  diagonal  matrix  fails  to  represent  all  linear  operators,  we 
continue  our  analysis  of  the  invariant  properties  of  linear  operators  We 
shall,  however,  see  the  concept  of  the  "diagonal"  return  in  our  examination 
of  the  effect  a  linear  operator  has  on  certain  subspaces  of  a  vector  space. 

Dejin-itton 

A  subspace  U  of  V  Is  inuariant  under  T ;  V  — >  V  if  x  e  U  Implies 
that  T(x)eU. 


The  Importance  of  U  being  an  Invariant  subspace  of  Tis  that  T 


It 


(restricted  to  U)  is  in  fact  a  linear  operator  on  U. 

We  shall  now  continue  to  simplify  the  matrix  representation  of  Tby 
distinguishing  smaller  subspaces  of  V  as  invariant  subspaces  under 
restrictions  of  the  linear  operator  T.  and  by  identifying  preferred  bases  for 
each  invariant  subspace. 

Let  T  be  a  linear  operator  on  the  n-dimensional  vector  space  V,  and 
let  U  be  a  k-dimensional  subspace  of  V  that  is  invariant  under  T 

Suppose  Xj  =  {x^,  X2, ...,  >;^}  is  a  basis  for  U.  We  can  extend  this  basis 
to  a  basis  X  =  {x^,  xj, ...,  x^,  x^+,, ...,  x^}  of  V.  Notice  that  since  for  any 
vector  w  G  U,  T(u)  g  U,  then 

T(Xj)  =      a^|X,+     a,2'<'2  ■'"■'"  "^' Ik '^k'*'  "^'^k+l  "*"••••  "*"  '^'^n 

TCxg)   =      a2iX,+     0,22 '^'2  ■'"■•■•■'"  <^2k'^k"*"  *^^k+1  "*■••■•  ■*"  *^^n 

T(x^)  =     a,^,  x,+     (x,^X2+....+ a,^,^x,,+  Ox,^^, +  ....+         Ox„ 

'^^'^+1^   =  <^k+11  '^l  ■•"  ^k+12'^2"'' "•"  "^'k+ln^n 

'^^'^+2'   ^  ^k+21  ^1  ''"  ^k+22'^2"*" ■•"  <^k+2n'^n 

''"^^   =       «^n1^1+      ^n2'^2+ +       "^nn'^n 

Thus  With  respect  to  the  basis  X,  the  matrix  representation  of  T  will  have 


12 


the  form 


^   = 


L   0      T2 


where        I  Ti]    is  the  k  x  k  matrix  representation  of  the  T restricted  to  U. 

[T2]    is  a  (n-k)x(n-k)  matrix. 
and  IT3]    is  a  kx(n-k)  matrix. 

If  [  T3]  =  0,  we  would  get  the  following  "diagonal"  form: 

Notice  that  [  T^j  =  0 Jf  and  only  if  U^  d  T  (U^).  In  order  to  obtain  the  above 
form,  we  now  identify  a  special  set  of  subspaces. 

Two  subspaces  U  and  W  of  a  vector  space  V  are  said  to  be 
complementary  (or  the  complement  of  each  other)  if  U  n  W  =  {0}  and 
U  +  W  =  V. 

V  is  the  direct  sum  of  U  and  W  if  and  only  if  U  and  W  are 
complementary  subspaces  of  V.  In  this  case  we  use  the  notation  V  =  U  ©  W. 


We  shall  use  the  following  result  in  our  discussion; 


Lanm» 


V  =  U  ©  W  if  and  only  if  each  r  e  V  can  be  written  uniquely  as 


i"'!";;:.  t 


Vr.  mi-KiJ 
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z.=  x  +  y  wherexeU  andy  e  V  D 

Let  T :  V  — >  V  and  let  V  =  U  ®  W.  If  U  and  W  are  both  invariant  under 
T.  then  T  is  said  to  be  reduced  by  the  pair  (U,W). 

The  importance  of  the  reduction  of  a  linear  operator  T  by  (U,W)  is 
that  T  can  be  regarded  as  the  direct  sum  of  two  operators:  Tj,  the 
restriction  of  T to  U;  and  Tj,  the  restriction  of  T to  W.  This  follows  from 

the  fact  that  f or  r  e  V  and  z  =  x  +  y, 

T(z)  =  T(x+  y)  =  TW  +  T(y)  =  Ti(x)  +  T^ivi)    (since  x  e  U  and  tj  e  V) 

Thus  we  shall  write  T  =  Tj  ©  Tj 

We  extend  the  idea  of  the  reduction  of  a  linear  operator  as  follows: 
Let  T :  V  — >  V  and  V  =  U^  0  U2  ®  ...  ®  Uj,.  Let  T  be  reduced  by  (Uj,  U2, ... ,  Uj^), 
and  let  Tj  be  the  restriction  of  T  to  U^.  Then  T  =  T^  ®  To  ©  ...  ©  T^. 

We  now  modify  our  original  bases  X  and  X^  to  accomodate  the 
reduction  of  the  linear  operator  Ton  V  by  (U,W).  the  complementary 
subspaces  of  V  which  are  both  invariant  under  T. 

Given Xj  =  {x^ , Xj, .., x^}  as  a  basis  for  U  and X2  =  {x^+i , -^+2'  -' '^ 
as  a  basis  forWJf  V=  U  ©  W,  then  X  =  {x^ ,  rx2,  ...,x^}  is  a  basis  for  V. 


J?91 


Then  since  U  is  invariant  under  T, 


i=  1 


and  since  W  is  invariant  under  T, 
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J=  I,  ^,  •,  k 


i=k+l 


;>' =  l<+ 1 ,  k+2, ..,  n 


Thus  the  matrix  of  T  with  respect  to  the  basis  X  will  be  of  the  "diagonal" 
form 

Ti        0 
0        T2J 


where  ( TJ  is  the  matrix  of  T^  (the  restriction  of  Tto  U)  with  respect  to  the 
basis  Xj,  and  [  T2I  is  the  matrix  of  T2  (the  restriction  of  T  to  W)  with 
respect  to  the  basis  Xg. 


Projections 


In  discussing  the  direct  sum  decomposition  of  the  vector  space  V 
into  L)  and  W,  each  an  invariant  subspace  under  T,  we  examined  the  special 
case  where  the  k  x  (n  -  k)  matrix  [  T3I  =  0. 
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We  now  describe  a  special  linear  operator  !E  that  helps  distinguish 
the  invariant  subspaces  under  the  linear  operator!,  and  in  doing  so  reduces 
T. 

ttefmition 

The  operator  Eon  V  is  a  projection  on  V  if 
i)  V  =  U  ©  W  where  U  =  Rj.  and  W  =  N^ 

11)  If  for  any  xgV,  !E(r)  =  x  where  r=x+y  with  xeU,  yeV/ 
We  say  that  Els  a  projection  on  U  (  Rj.)  along  W  (  Nj.). 

We  first  note  that  a  projection  is  indeed  a  linear  operator.  Given 
conditions  i)  and  11) Jet  z^ ,  Z2  ^  V  where  z,  =  x^  +  f|,  and  Z2  =  ^2  +  th  ,  and 
let  a  be  any  scalar. 

Then  (zi+z2)=  (x,+  x2)+ (Vi+tfe^ 

Since  (x,  +  X2  )  e  U  and  (tj^  +  ^2  )  e  W, 

fronnthe  definition  E(z,+  Z2)=  (xi+x2)  =  E(zi)+  ECzg) 

On  the  other  hand,  azj  =  «,  >4  +  cttj^ 

Now  since  axj  e  U  and  atij  e  W,      E(ctZj)=  axj  =  aE(zj) 

Thus  Els  linear.  Since  E :  V  — >  U  and  V  3  U,  E is  a  linear  operator  on  V  D 

We  emphasize  an  Important  connection  between  projections  and  the 
direct  sum  decomposition  of  a  vector  space.  Given  a  projection  on  V,  we 
automatically  create  a  direct  sum  decomposition  of  V;  I.e.  V  =  R^®  Nj. . 
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Conversely,  any  direct  sum  decomposition  of  V  induces  a  projection 
operator. 

The  following  theorem  gives  some  properties  of  projections  that  v^e 
shall  use  later. 

Theorvtn  2 

Let  £  be  a  linear  operator  on  V.  Then 

i)£ls  a  projection  on  V  if  and  only  if  E^  =  E 

ii)  E  is  a  projection  on  a  subspace  U  along  a  subspace  W  if  and 

only  if  I  -  E  is  a  projection  on  W  along  U. 
Vrooj 

(i)  Let  us  assume  that  E  is  a  projection  on  V.  We  must  show  that  E^  =  E, 

that  is,  E"^  (z)  =  E  (z)  for  any  z  e  V.  Since  E  is  a  projection  on  V,  we  know 
that  V  =  R^0  N^  and  given  any  z  e  V, 
we  can  write  z=x  +  t|  where  x e %, y  e N^ 

Then  E^  (z)  =  E(  E(z) ) 

=  E(E(x  +  t|)) 

=  E(E(x)  +  E(i,)) 

=  E(E(x)) 

=  E(x) 
But  E(z)=E(x+y) 

=  E(x) 
Therefore  E^  =  E . 


Sr:  jC 


I'i.fui  'r--i'  tfe.t.' 
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Conversely,  suppose  t^  =  E .  We  must  show  that  E is  a  projection  on 
V. 

Let  W  =  { *j  e  V  I  E  (y)  =  0  }  and  U  =  {  x  e  V  I  £  (x)  =  ^ } 

Then  W  =  Np  and  %^U 

Now  let  X. E  R^ .  Then  there  exists  a  r  e  V  such  that 

E  (z)  =  X 
Then  £2(z)  =  E(x) 

But  si  nee  E^  =  E,  E^  (r)  =  E  (z)  =  x 

Therefore  E  (x)  =  x 

ThusxeUandUDRp.  .-.       U  =  Rp 

To  show  E is  a  projection  on  V  it  now  suffices  to  show  that  R^  n  N^  =  {0}. 

Let  X  e  Rp  n  N^ .  Then      x  e  R^      and     x  e  N^ 
E  (x)  =  X       and      E  (x)  =  0 
.-.     X  =  0 
Therefore  E  is  a  projection  on  V. 

ii)  Let  us  now  assume  that  Eis  a  projection  on  U  along  W  and  show  that 

I-Eis  a  projection  on  W  along  U.  First  consider! -E: 

(r-E)2=(r-E)(r-E)=H-lE-El  +  EE=I^-E-E  +  E2=r-2E  +  E  =  r-E 
Thus  I  -  E  is  a  projection.  We  show  that  I  -  E  is  a  projection  on  W  along  U. 


nnf. 
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Now  given  any  r  g  V,  since  E^  =  % 

Then  £:i(r-£)i]-0 

But  if  E(?0  =  0,  x=  0  or  X.  G  N^=  W.  Thus  (I  -  E)  r  =  0  or  (I  -  E)  z  g  W  for  all 

z  G  V.  Therefore  (I  -  E)  is  a  projection  on  W  along  U. 

Conversely,  let  us  suppose  that  (I  -  E)  is  a  projection  on  W  along  U. 
We  must  show  that  E is  a  projection  on  U  along  W. 
Since  (I  -  E)  is  a  projection, 

(r  -  E)2  =  r  -  E 

Then  (r-E)^  -  (r-E)  =  0 

i2-2E+E2-I  +  E  =  0 

I  -  E  +  E^  -  r  =  0 
.-.       e2  =  E  . 
Therefore  E  is  a  projection. 

Now  since  (I  -  E)  is  a  projection  on  W  =  Ri_^ along  U  =  Ni_p,  for  anyzG  V, 

we  can  write  z=x+i|  xgRj-j;.*! gNj.^ 

Then  (I-E)z=i;j  =  r-x 

or  z  -  "^iz)  =  z  -  X 

Thus  for  all  zgV,  E(z)=  xgU 

But  E  IS  a  projection.  Therefore  E  is  a  projection  on  U  along  W  ■ 


itT    , 
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The  next  two  theorems  show  how  a  projection  £  helps  distinguish  invariant 
subspaces  under  the  linear  operator  T  and  how  E  reduces  T. 

TTicorem  5 

Let  T  be  a  linear  operator  on  V  and  let  U  be  a  subspace  of  V. 
i)  If  U  is  invariant  under  T,  then  for  every  projection  Eon  U,  ETE=TE. 
ii)  If  ETE=TEfor  some  projection  Eon  U,  then  U  is  invariant  under  T 
Proof 

i)  Let  us  suppose  that  U  is  invariant  under  T and  let  E be  any  projection 

on  U.  We  must  show  that  ETE=  TE . 


Since  E  is  a  projection  on  U, 


V  =  U®W  u  =  Rj.  W  =  N5 


and  for  anyzG  V,  we  can  find  a  unique  xeU  andtiB  W  such  that  z=x+y 
and  Hz)  =  x 

Then  since  x e  U  and  U  is  invariant  under  7, 

TE(z)  =  T(x.)  =  X 
Also  since  xeU  and  E is  a  projection  on  U, 

ETEXz)  =  Hx)  =  X 
By  equating  the  two  expressions  forx, 

EIE=TE  for  every  projection  Eon  U. 

ii)         Now  let  us  assume  that  ETE=  TE  for  some  projection  E  on  U.  We 
must  show  that  U  is  invariant  under  T. 


?   rtf9t03tn 
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Let  X  G  U.  We  must  show  that  TW  g  U. 

Since  £TE=  TE  for E a  projection  on  U, 

"BTEktO  =  TE(x) 

Since  xeU  and E is  a  projection  on  U,  Hx)  =  x.Thus 

I:T(x)  =  T(x) 
But  because  E is  a  projection  on  U,  this  means  that 

T(x)  G  U 
Therefore  U  is  invariant  under  T  ■ 

Let  T be  a  linear  operator  on  V  and  let  V  =  U®  Vf  TIs  reduced  by 
(U,W)  if  and  only  if  £T  =  TEfor  any  projection  Eon  U  along  W. 
Proof 

Let  us  suppose  that  T  is  reduced  by  (U,W)  and  that  E  is  any 
projection  on  U  along  W.  We  must  show  that  £T  =  "TE . 

Let  X  G  U  Since  T  is  reduced  by  U,  U  is  invariant  under  T  and 

T(x)  G  U 
Thus  for  any  projection  E  on  U, 

£T(x)  =  T(x) 
Also  since  E  is  a  projection  on  U,  x=  E(x).  Then  by  substitution  we  get 

ET(x.)  =  TE(x) 


f  rtJ3t03<{l 
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Therefore  !E7  =  TE  for  any  projection  E  on  U  along  W. 

Conversely,  let  us  suppose  that  V  =  U  ©  W  and  for  any  projection  £ 
on  U  along  W,  £T  =  TE  .  We  must  show  that  (U,W)  is  a  reducing  pair  for  T. 

Since  V  =  U  ®  WJt  suffices  to  show  that  U  and  W  are  each  invariant  under T. 
Let  X  e  U.  Then  since  £7  =  TE, 

Err<x)  =  TE(x) 

Also  for  E a  projection  on  U  and  x e  U,  Hx)  =  -k . 
Thus 

ET(x)  =  T(x) 

But  this  is  possible  only  if  T(x)  e  U.  Therefore  U  is  invariant  under T 

Now  let  y  e  W.  Then  since  £T  =  TE, 

ET<t,)  =  TE(y) 
But  since  W  =  N^ ,  for  y  e  W,  Hy)  =  0  . 
Thus 

EJ<V)  =  0 
But  this  is  possible  only  if  T(tj)  e  W  =  Nj. .  Therefore  W  is  invariant  under  TB 

Before  we  begin  the  next  stage  of  developing  the  Jordan  form,  we 
give  a  result  which  emphasizes  a  more  complete  connection  between  the 
direct  sum  decomposition  of  a  vector  space  and  projections. 


^'  f- 


HlUi 


22 


TTicoretn  5 

If  Ej,  ^2'    •  ^-k  ^^^  linear  operators  on  a  vector  space  V  such  that 

a)  r  =  El  +  £2  +  +  ^k  anci  b)  E^E j  =  0  if  i  =:  j ,  then 
i)  eachE^,  v=  1,  2,  .../k  Js  a  projection 
ii)  V=  Wj  ©Wg®  ...  ®Wjj  where  W^=Re^,  i=  1,2,  ...,k 

Conversely,  if  V  =  W^  ©  Wg  ®  ...  ®  W^  ,  then 

i)  there  exist  projections  E^,  £.,   .,  E^  which  satisfy 

conditions  a)  and  b) 
ii)W^=REi.  i=  1,2,  ...,k 
Proof 

Suppose  E|,  E2, ...,  E^  are  linear  operators  on  V  that  satisfy  the 

conditions  a)  and  b). 

Let  a)  be  multiplied  by  E^  to  get 

E,=  E,Ei+E,E2  +  ...+  E,E,+  ..+  E,E, 
Using  condition  b)  this  simplifies  to  give 

£^-  £^2  i=  1,2,...,k 

Therefore  i)EJs  a  projection  for  i=  1,2,  ...,k. 

Nowlet  W^=Re^,  i=  1,2,  ..,k.  Then  given xgV, E^W  eW^ .  Let  a) 
be  applied  toxto  give 


-oil 


23 


x=  (Ej  +  E2  +  ...+  Ek)x 

k  k 

Thus  x=    2  E^(x)  =    2  x^  where x^eW^ 

L  =1  i  =1 

This  means  that 

V  =  Wi  +  W2  +  ...  +  Wjj 
To  show  that  V  is  the  direct  sum  of  the  W^  s,  it  is  sufficient  to  show  that 

for  any  x  g  V,  the  above  representation  of  x  is  unique. 

k  k 

Let  x=    2  x^    =    2    y^  where  x^,  y  1^6  W^ 

L  =1  t  =1 

Then  since  t^  is  a  projection  on  W-  ,  £^(x^)  =  x-  ,  E-(ij^)  =  y ^ 

k  k 

Therefore  x=    2  EJx^)    =     2  EJy^) 

1=1  t  =  1 

By  applying  E.  to  this  equation  and  by  using  condition  b)  we  get, 
Ej(x)=  Ej2(^)=  Ej2(^) 

Thus  the  representation  of  xis  unique. 

Therefore  ii)  V  =  W^  ®  W2©  ...  ©  W^ 

where  W^=  R^^,  i=  1,2, ...,  k 

Conversely,  let  us  suppose  that  V  =  Wj  ®  Wj  ©  ...  ©  Wj^.  Then  given 
any  x  e  V,  there  exists  a  unique  x^g  W,_  such  that 
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k 

L  =1 


We  define  an  operator  £^  by  E^(x)  =  x^.  Since  x^  is  unique,  E^  is  well 

defined. 

Now  £Jx  +  i^)  =  x^  +  i^^=  EJx)  +  E,^(y) 

Thus  E^  is  linear. 

Also  £^2(^)  =  E^(  x^)  =  x^=  EJx) 

Thus  £i^  =  £t 

Thus  £^  is  a  projection.  Since  x^eW^  andE^(i<^)  =  x^,  E^  is  a 
projection  on  W^. 

Therefore  ii)  W^=  Re^^,  i=  1,2, ...,  k 

To  complete  the  proof  we  need  to  show  that  the  projections  E^  s  satisfy 

conditions  a)  and  b). 

ForanyxsV,  x  =  Xi+ X2+ ...  +  x^j 

Since  by  definition  ^^{  x)  =  x^, 

X  =  Ej(x)+  E2(x)+  ...  +  Ejj(x^=  (Ej  +  E2  +  ...+  Ejj)x 
Thus  I  =  Ej  +  E2  + ...  +  E jj,  and  condition  a)  is  satisfied. 
Suppose  X  G  W=  and  1  *  i .  Then  since  W^  n  W:  =  0  and  Ei(  x)  =  x, 

E^Ej(x)=E^(x)=0 
Therefore  E^Ej  =  0  if  i  *  ;j,  and  condition  b)  is  satisfied  ■ 


f[^v 
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The  hinihuh  poltmohial  of  a  linear  operator 

Let  Tbe  a  linear  operator  on  V.  We  shall  show  that  there  exists  a 
poiynomia!  in  t.  say  p(7?,  wun  p(T)x.=  o  ror  every  xe  v. 

Let  us  assunne  that  {xj,  -x^, ... ,  iXj^}  is  a  basis  for  V.  Now  consider  the  set  of 
n  +1  vectors  {-x^^Tix^},  T^  (xj), ... ,  7^  (x^)}.  Since  V  is  of  dimension  n,  any 
set  of  n  +1  vectors  will  be  linearly  dependent. 

Thus  there  exist  scalers  «,-=,  j  =  0,  1,2, ... ,  n,  such  that  the  a:.-  s  are  not  all 
zero,  but 

n 

2     (Xi=TJ(xi)=  0 

Since  there  exists  a  largest  integer  k,  such  that  1  <  k  <  n,  for  which  a^^  x  0, 
the  above  linear  combination  can  be  written  as 

k 


I     aijTJ(xi)=  0 


By  expansion  we  get 


(XjoXi  +  (XiiT(xi)  +  ...+  aijjT'^(xi)=  0 


k-l 

Then  7^{o^)=  zL     2    otj^TJ^) 


or 


k  -1 
■k 


(T"^  +  J_       I     otj^Tl)  x^  =  0 
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k  - 1 
Now  let  Fi("t)=  t"^  +  _L       2     aj^TJ 

Then  FjCT)  xj  =  0.  (Notice  that  PiCT)  is  a  monic  polynomial).  Similarly,  we 
can  find  monic  polynomials  in  T such  that 

PoCD  ?<2  =  *^ 

PjCT)  X3  =  0 

F«m,s,  =0 
Then  since  {x^,  -k^,  ...  ,1^}  \sq  basis  for  V,  we  can  construct  a  polynomial  in 
T  which  annihilates  any  vector  in  V  as  follows: 


Let  p(r)=  IT  Fi(T) 

i  =  l 

Then  given  any  xe  V,  where  in  terms  of  the  basis 


k=  1 


we  get  p(T)x=   TT  ^^(T)  2    p^x^ 

1=1  k=l 


Using  the  properties  of  commutativity  and  linearity  of  polynomials  we  can 
write 

a.  n 


p(T)  x=   1  o^  (  TT  Fi(T) )  Fk(T)  x^ 


k= 1  i=  1 

i*k 
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Since  Pjj(r)  ^  =  0,  k  =  1 ,  2, ... ,  n,  pCT)  x=  0  for  every  x  e  V  D 

Now  since  there  exists  a  monic  polynomial  in  T,  p(T),  with  p(T)  x=  0 

for  ©very  *cg  V,  it  follows  that  there  exists  a  monic  polynomial  of  smallest 

degree,  say  co(T),  such  that  ro(T)  x,=  0  for  every  xe  V.  This  minimal 
polynomial  ro(T)  =  0  is  called  the  minimum  polynomial  of  T. 
We  have  just  proved  the  following: 

Theorem  6 

Every  linear  operator  has  a  minimum  polynomial  ■ 


Eigenvalues  and  eigehvectors 

We  now  focus  on  a  special  type  of  invariant  subspace  of  the  operator 
Ton  V.  When  T operates  on  a  vector  in  this  special  subspace,  the  vector  gets 
multiplied  by  a  scalar.  We  shall  prove  an  important  relationship  between 
this  scalar  and  the  minimum  polynomial  of  T. 

ttefinition 

A  is  an  elgenualue  of  T  an  operator  on  V  if  there  exists  an  x  e  V 
with  X  3t  0,  such  that  T(x)  =  Ax . 

If  A  is  an  eigenvalue  of  T  and  T(x)  =  Ax ,  then  x  is  an  eigenuector  of 
T  corresponding  to  the  eigenvalue  A. 
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Now  given  ro(T),  the  minimum  polynomial  of  J,  we  can  construct  a 
polynomial  mCt)  over  the  complex  field  |C,  which  has  the  same  coefficients 
as  those  of  m(T). 

Example:  m(T)  =  T^  +  ZP  -77^+  7-41 

m(t)  =  f*  +  3t3  -  7t2  +  t  -  4 

Since  |C  is  an  algebraically  closed  field,  we  can  write  a>(t)  as  the 

product  of  linear  factors: 

k 

m(t)  =  TT  (t  -  Apl 
j=i 

where  the  A^  s,  j  =  ],2, ... ,  k,  are  the  distinct  roots  of  md)  =  0.  We  shall 
show  that  the  Aj  s  are  the  eigenvalues  of  T. 

k 

We  define  m.(t)  =  (  TT  (t  -  X^Y\  )  (t  -  A^)n  - 1 

Thus  fD(t)  =  (t  -  A^)  m^(t) 

Now  since  mjt)  is  of  degree  less  than  m(t),  and  given  that  ro(t)  corresponds 
to  the  minimum  polynomial  ro(T),  it  follows  that  there  exists  at  least  one 
vector  x^  e  V  such  that 

But  since  m(T)  is  the  minimum  polynomial, 

m(T)x^=  0 


(T)tn 
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Therefore  (T  -  A^I)  [rojT)  x  J  =  0         D 

Thus  we  have  shown  that  a  root  of  ro(t)  is  an  eigenvalue  of  T. 

LemfTva 

IfAj  and  A2  are  distinct  eigenvalues  of  T and  xj  and  t^   a''©  their 

corresponding  eigenvectors,  then  x^  x   x^. 
Proof 

Suppose  X  is  an  eigenvector  of  T  with  corresponding  eigenvalues  Aj 


and  A2.  Then 

T(x)=  Ajx     and      T(x)  = 

A2X 

Thus                                                  Ajx  =  A2X 

Since  x#  0,                                         A^  =  Aj 

The  lemma  follows  by  contraposition  ■ 

Theorem  7 

A  is  a  root  of  ro(t)  =  0,  where  cd(T)  is  the  minimum  polynomial  of  T, 

if  and  only  if  A  is  an  eigenvalue  of  T. 
Proof 

Suppose  A  is  a  root  of  ro(t)  =  0.  We  showed  above  that  A  is  an 
eigenvalue  of  T. 

Conversely,  suppose  A  is  an  eigenvalue  of  T.  We  must  show  that  A  is 
a  root  of  (n(t)  =  0. 


(^'.■0 
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The  proof  is  by  contradiction.  Let  us  assume  that  ro(T)  is  the 
minimum  polynomial  of  T and  that  A  is  an  eigenvalue  of  T such  that  A  is  not 

a  root  of  CD(t)  =  0.  We  show  that  this  is  impossible.  We  can  factor  iD(t)  Into 
linear  factors  that  are  not  necessarily  distinct  as  follows: 


m(t)=  TT  (t-Aj) 


Let  iDt(t)  =  TT  (t  -  A:)  where  k  <  r  -  1 


Now  let  X  be  an  eigenvector  of  T corresponding  to  the  eigenvalue  A.  Since  A 
is  not  a  zero  of  in(t)  =  0,  A  i  A^  for  every  j=  1,  2, ... ,  r. 
Then  either 

i)m^{T)x=  0  forall  l<=  1,2, ...  ,r- 1 

or  11)  mjjCr)^  ^  0  for  some  k  =  1 ,  2, ... ,  r  -  1 

Suppose  1)  (o,j(T)x=  0  for  all  k  =  1 ,  2, ... ,  r  -  1 . 
Then  in  particular, 

(T  -  A^Dx  =  0 
Thus  X  Is  an  eigenvector  of  T corresponding  to  the  distinct  eigenvalues  Aj 
and  A.  But  by  the  lemma,  this  is  impossible. 

On  the  other  hand,  suppose  11)  fDjj(T>xr  0  for  some  k  =  1,  2, ... ,  r  -  1.  Then 


Cfj 


8d  A  i- 
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there  is  a  largest  k  <  r- 1  such  that  fio^(T)xx  0  but  fDjj  +  i(T)x=  0. 

Then  m^  + 1 (T)x  =  (T  -  Aj^  +  ^l)  [to^iTH  ]  =  0 

This  implies  that  ro^CDxis  an  eigenvector  or  T  corresponding  to  the 
eigenvalue  Aj,+  i.  But  since  x is  an  eigenvector  of  T  corresponding  to  the 
eigenvalue  X, 

(T  -  AI)  [m^dk  ]  =  (coj^m  ]  (T  -  AD  X  =  m^(T).  0 

Therefore  (T  -  AI)  (co^(T)x  ]  =  0 

Thus  cn^CDx  is  an  eigenvector  of  T  corresponding  to  the  distinct  eigenvalues 

Ajj  +  J  and  A  ,  which  again  is  impossible  ■ 

Let  the  matrix  representation  of  the  operator  Ton  IC*  with  respect 
to  the  basis  {x^,  x^,  x^,  x^ }  be  given  by 


T]    = 


2  110 
0  10  0 
0-1-1  0 
0      0      0      2  J 


Then 
and 


Thus 


TCxj)  =  2xi 
T(xi)  -  2xi=0 

Fi(t)  =  t-2 
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Similarly,  TCx^)  =  >t^  -  x^ 

T(.Xj)  ■*■  ^  =  ^ 
t2(«3)  +T(x3)  =  T(xi)  =   2  x^  =   2  1  TCxj)  +  x^ 
t2(x3)  -  T(X3)  -  2  x^  =  0 
Thus  F3(t)  =   t^  - 1  -  2 

PjCt)  =  (t-2)(t+  1) 

Also  TCxg)  =   ^  +  ^  -  ^ 

TCxg)  -  >^  =    ''^1  ~  ^-i  =  T(x^) 
t2(x2)  -  T(xp  =  tH-k^) 
T^(X2)  -  Kxg)  -  IT(X2)  -  x.  ]  =  T^Cxj)  -  T(x^) 

tH-k^)  -  2  -Kx^)  +  X2  =  tH-}^)   -  T(x3)  =  2  xg 
T^(x2)  -  2  t2(x2)  +  T(x2)  =    2  TCx^)  =  2  I  J{i^)  -  x^  1 
tH-k^)  -  2  tH-k^)  -  T(xp  +  2  xo  =  0 
Thus  F2(t)  =t3-2t2-t+2 

F.Ct)  =  (t-2)(t-  n(t+  1) 

Finally  T{%^)  =  2%^ 

TCx^)  -  2  X4  =  0 
Thus  F4(t)  =  t  -  2 
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Now  p(t)  =  TT  Pi(t)  =  (t  -  2)4  (t  -  1 )( t  +  1  )^ 

i=  1 


Thus  p(T)  -  (T  -  21)4  (J  -  r)(  T  +  1)2 

Observe  that 

F2(T)x-(T-2r)(T-I)(T+r)x^=0         i=  1,2,3,4 

Then  the  minimum  polynomial  of  T,  m(Tj,  is  in  this  case  P2(T). 

Thus  m(T)=  (T-2r)(T-r)(T  +  r) 

Therefore  the  eigenvalues  of  Tare  2,  1,  and  -1. 

N.B.  The  degree  of  m{T)  <  the  dimension  of  V. 


The  characteristic  polynomial  of  a  linear  operator 

In  the  next  section,  we  shall  present  the  main  theorem  used  in 
constructing  the  Jordan  form,  a  theorem  which  depends  on  the  idea  of  the 
minimum  polynomial.  But  first  we  elaborate  on  the  observation  that  the 
degree  of  rod)  <  the  dimension  of  V. 

Observe  that  in  our  example  above, 

ro(T)=  (T-2I)(T-r)(T  +  r) 
Thus  the  degree  of  ro(T)  is  3,  while  V  is  of  dim.ension  4. 


won 


(T')tP  iiA<' 


zjoqoi 
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As  implied  in  the  Introduction,  the  special  basis  we  shall  construct 
for  the  Jordan  form  consists  of  certain  invariant  basis  elements,  namely, 
the  eigenvectors  of  T.  As  basis  elements,  these  eigenvectors  must  be 
linearly  independent  and  must  span  V. 

However,  although  cd(T)  always  indicates  the  distinct  eigenvalues  of 
T(it  may  also  repeat  some),  as  with  our  example,  the  number  of  roots  of 
co(t)  need  not  equal  the  dimension  of  V.  Thus  given  the  minimum  polynomial 
of  a  linear  operator,  we  cannot  always  determine  which  eigenvalue(s)  is 
(are)  repeated.  Therefore  we  may  be  unable  to  expand  our  initial  number  of 

eigenvectors  ( =  number  of  roots  of  m(t) )  to  an  eigenbasis  which  spans  V. 

It  is  the  characteristic  polynomial  of  T  which  always  provides  us 
with  the  means  of  determining  which  eigenvalues  are  repeated  and  the 
number  of  such  repetitions. 

Let  IT]  be  a  matrix  representation  of  the  linear  operator  Ton  the 
n-dimensional  vector  space  V.  If 

c(A)  =  det  ( [  T  ]  -  A I ) 

then  c(A)  is  called  the  characteristic  polynomial  of  T 


We  compute  c(A)  for  our  previous  example: 
"2  -  A       1 


det  ( I T  ]  -  A  r )  =  det  I     ^ 

0 
0 


1  -A         0  0 

-1        -1-A       0 
0  0        2-A_ 
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c(A)  =(2  -A)(  1  -A)(-1  -A)(2  -A) 

Our  discussion  of  the  characteristic  polynomial  of  a  linear  operator 
Is  limited  to  observing  that  the  roots  of  this  polynomial  provide  dim(V) 

eigenvalues  (not  necessarily  distinct)  of  T.  In  our  example,  the  roots  of  c(A) 
are  2,  1,-1,  and  2.  Thus  the  eigenvalue  "missing"  from  the  roots  of  cd(T)  is 
a  repeated  2.  The  characteristic  polynomial  is  thus  a  vv'ay  to  find  "all"  the 
eigenvalues  and  eigenvectors  of  a  linear  operator.  However,  finding  the 
determinant  of  a  n  x  n  matrix  is  not  practical  for  values  of  n  exceeding  3  or 
4,  since  it  requires  n  !  (  n^  +  n  )  multiplications. 

Therefore,  we  state,  but  do  not  prove  the  following  theorem: 

Theoretn  8 

Let  T  be  a  linear  operator  on  a  vector  space  V.  Then  the  roots  of 
c(A)  =  0  are  the  eigenvalues  of  TB 


W.  B.  Eigenvalues  and  eigenvectors  are  sometimes  called  characteristic 
ualues  and  characteristic  uectors,  since  "eigen-"  is  the  German  prefix 
which  means  "characteristic"  (belonging  to).  The  characteristic  polynomial 
of  a  linear  operator  is  the  embodiment  of  these  invariant  characteristics. 
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The  decomposition  of  am  operator 

We  now  present  the  nnain  theorem  used  in  constructing  the  Jordan 
form. 

Tlicorenn  9 

Let  ro(T)  be  the  minimum  polynomial  of  Ton  the  vector  space  V  over 
the  algebraically  closed  field  IF.  If 

k 

fD(t)=  TT  (t-Apn 

where  X^  *  Xj  for  i  ;^  j  and  rj  >  0  for  i=  1,  2, ... ,  k,  then 

i)  V  =  Uj  ®  IJ2  ®  ...  ©  Ujj  where  U^  is  the  null  space  of  (T  -  X^DH 

11)  Li^  is  Invariant  under  T  for  each  i . 

ill)  If  T^  is  the  restriction  of  Tto  U^,  then  (T-  X^H  is  the  minimum 
polynomial  of  T^. 
Proof 

Let  us  define  fOj(t)  by 

n,.(t)   =        to(t)     =    TT  (t  -  xp""] 
(t-X/i  1=1 

j*i 

Then  the  greatest  common  devisor  of  {  mi(t),  cog^*^'     '  ***k^*^ '  ^^  ^- 


flOIAS[3qO  HA  iO  k«T)IT120q: 


't^ry^v. 
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Thus  there  exist  polynomials  q^Ct)  such  that 

k 

2    q^Ct)  to^it)  =  1 

i=l 

we  write  this  identity  in  t  as  an  identity  in  T. 


Thus  1    qiCD  f»i(T)  =  r 

i  =  l 


If  we  let  Ei=  q^d)  cOiCT).  then 


Thus  2   £i   =  I 

i=l 


Notice  that 


(o^mtofD  =       ^^'^      . 


m(T) 


(T-AiOn       (T-A^r)''i 


Therefore  for  i  *  j,  10^(7)  rOjCD    =     mCD     TT    (T-Apl)''p 


Hence,  if  i*j,  q-(T)  mi(T)  qj(T)  mj(T)  =  0,  since  it  is  a  nnultiple  of  m(T).  In 
other  words. 


EiEj  =0  if  Uj 


Also  we  have  shown  that 


E1  +  E2+  •+£&=  r 


•jilf  ftO!'" 
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By  Theorem  5,  these  conditions  imply  that  the  E^  s  are  projections  on  V 
which  lead  to  the  following  direct  sum  decomposition  of  V: 

V  =  Ui  ®  U2  ®  ...  ©  Ujj  where  U^  =  Rf  j 

To  complete  the  proof  we  must  prove  that  the  U^  s  fulfill  the  three 
conditions  described  in  the  theorem. 

i)  We  must  first  show  that  U^  is  the  null  space  of  (T-  A^Dn  ,  i=  1,2,...,  k. 

Let  X  G  U^.  Then  £jW  =  x 

Thus  (T-  XJ.f\  ^  =  (T-  A^DH  £.(x) 

(T  -  \lY\  X  =    _^^'^_  qiCn  co^m  K  =  ro(T)  q^Cr)  x  =  q^CT)  m(T)  x 
mi(7) 

Then  (T  -  Xj:f\  x  =  0 

Thus  X belongs  to  the  null  space  of  (T-  A^Dn  .  Therefore  (T-  A^DH  d  U^. 
On  the  other  hand,  suppose  x  is  in  the  null  space  of  (T-  A^DH  . 

k 

Since  to^i)    =    TT  (T-  A^DH 

i  =  1 

for  j  *  i ,  q  =(T)  m  j(T)  is  a  multiple  of  (T-  A^DH  . 

Hence  EjW  =  q  =(T)  m  =(T)  x=  0  since  x is  in  the  null  space  of  (T-  A^DH  . 


I  Mb' 


mf\' 
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But  If  Ej(x)  =  0,  for  i  s  j  Ejfx.)  =  x 

Then  x  e  Uj 

Thus  Ui  z>  the  null  space  of  (T  -  AjDH  .  But  the  null  space  of  (T -  kj.)^\  z>  U^ . 
Therefore  U^  Is  the  null  space  of  (T-  X^DH  ,    i=  1,  2, ... ,  k. 

ii)  Next  we  must  show  that  U^  is  invariant  under  T for  i=  1,  2, ... ,  k. 

i.e.  we  must  show  that  if  x  e  U^,  then  T(x)  e  U^ .  Note  that  since  Ej  is  a 

polynomial  in  T,  T  commutes  with  Ej. 

LetxG  U-.Then  EjW  =  x 

Thus  EiW  e  Ui 

M„,,,  T*'     i..\  'TV'..\ 

IMUYY  i  J>jVA,y    =     i\A,y 

then  Ei  { T(x)  ]  =  T(x) 

But  Ej  [  T(x)  ]  G  U^.  Thus  IbO  g  U^ 

Therefore  each  Uj  is  invariant  under T,  i=  1,  2, ... ,  k. 

iii)  Finally,  we  must  show  that  if  T^  is  the  restriction  of  Tto  Uj,  then 

(T  -  A^  I)n  is  the  minimum  polynomial  of  T^. 

Let  Tj  be  the  restriction  of  T  to  U^.  Then  by  condition  i)  since  U^  is  the  null 

space  of  (T  -  \  lY\,  (T  -  \ lY's  x  =  0  f or  all  x e  Uj 

Let  s(T)  be  the  minimum  polynomial  of  T^.  Then  s(T)  divides  (T  -  A^  Vy\  .  (We 
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note  that  in  terms  of  T^,  sCTj),  the  minimum  polynomial  of  T^ ,  divides 

(Ti-AiDH). 

Then  for  any  x  e  U^,  s(T)x  =  0 

Also  for  any  x  e  U^  ®  U2  ®  ...  ®  U^ .  j  ®  Li  +  i  ©  ...  8  U^  , 

Thus  for  X  G  V,  s(T)  ro  i(T)x  =  0 

But  since  io(T)  is  the  minimum  polynomial  of  J,  it  follows  that  coCT)  divides 

s(T)  mi(T).  However,  by  definition  m(T)  =  (T  -  A^ DH  « .(T).  Thus 

(T-  A^nn  fD.(T)  divides  s(T)  (0^(7). 

In  other  words,  (T-AjDH  divides  to^it) 

But  by  our  original  assumption,  s(T)  divides  (T-  A^DH  . 

Therefore  sCT)  =  (T  -  A^  DH 

where  s(T)  is  the  minimum  polynomial  of  T^,  the  restriction  of  T  to  Uj  ■ 

We  observe  that  the  theorem  implies  that  U^  is  a  summand  of  V 
associated  with  the  eigenvalue  A^,  if  and  only  if  (T-AJ)  is  nilpotent  on  U^. 
Thus  when  T is  restricted  to  the  subspace  Uj,  it  has  only  one  eigenvalue, 
namely  A^.  The  subspace  U^  is  called  an  eigenspace  of  V 
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The  special  basis  for  the  jordav  form 

OF  A  NILPOTENT  OPERATOR 


In  this  section  we  shall  construct  the  special  basis  for  a  vector 
space  which  enables  us  to  determine  the  Jordan  matrix  representation  of  a 
linear  operator  that  is  nilpotent  on  that  vector  space.  As  we  shall  show,  the 
construction  will  be  analogous  to  the  construction  of  the  special  basis 
which  gives  a  Jordan  representation  of  any  linear  operator. 

First  we  examine  the  decomposition  of  a  vector  space  in  greater 
detail. 

Suppose  T  is  an  operator  on  V  that  is  nilpotent  of  index  k  on  V.  Then  "I*  =  0. 
Let  Nj  be  the  null  space  of  T' .  We  shall  show  that  for  i  <  j  ,  Nj  d  TMK) .  In 
other  words,  we  shall  show  that  Nj  is  invariant  under  T^  if  i  <  j . 
Let  t|  e  Nj .  We  must  show  that   THTHif))  =  0. 

TJ  (T^  (y) )  =  Ji  (TJ  (y) )  =  7  i  (0)  since  y  e  Nj 

and  TM0)=0 

Therefore  Nj  is  invariant  under T*  if  i  <  j  .  In  particular,  Nj  is  invariant 

under TJ'^  . 

Observe  that  tL    3  Nj  _  j 

r  k 

Let  {xj  j  ^  J  be  a  basis  for  Nj  _  ^.  Complete  this  to  a  basis  for  Nj,  say  {xj}  ^  =  j. 


<D  9(1)  31" 
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Define  Pj  _  ^  to  be  the  subspace  of  Nj  ,  spanned  by  the  basis  {x^}  i  =  j.  + 1 


Then 


Nj  =  Nj_,©  P^_, 


Observe  that  if  xe  Pj  _  j  and  X3t  0,  then 

TJ(x)  =0  but   Ti-Kx)2  0 

Now  since  T is  nilpotent  of  index  k  on  V,  it  follows  that 

V=  N,  =  P,.i®  N,.i 

=     Pk  -  1  ®    Pk  -  2   ©    "k  -  2 

Then  by  induction, 

V=  Pk-i®  Pk-2  ®     ®  Pi  ®  Po  ©  No 
But  Np  =  {0} 

Therefore  V  =  Pj^ .  ^  ®  Pj^ .  2  ®  ...  ©  P^  ©  Pq     D 

The  following  lemrna  helps  determine  the  special  basis  for  V  in 
terms  of  the  bases  for  P^,    i  =  1 ,  2, ... ,  k  -  1 . 


Lernmo. 

If  {x^}  ^  =  J  is  a  basis  for  P:,  then  a  basis  for  P= .  j  can  be  chosen  to 

p 
include  {T(xj) }  i  =  i  . 


fsed  9(1  J' 
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Proof 

Let  {xj  i  =  1  be  a  basis  for  Pj  and  («ii}  j  =  i  be  a  basis  for  Nj .  j .  We 

first  show  that  y  -   {^^,  ^^2'  ••  '  %'  '^^'*Hf'  '^^'<2^'  -  ^  "^^^^^  ^  '®  liriQarly 
independent. 

Suppose  IJ  is  linearly  dependent.  Then  we  can  have 

1  p 

i=l  i=l 

where  the  a^  s  and  p^  s  are  not  all  zero. 

q 

Since  {tjii}i=i  is  linearly  independent  being  a  basis  for  Nj.  J,   a^^O  for 

t  % 

i=  1,2,  ...,q,  unless     2  otjti^  =0. 

i  =  l 

For  pj,  i=  1,  2, ... ,  p,  there  exists  an  Integer  k  such  that  o  <  k  <  p  and  pj^  ;£  0. 

q  k-i 

Thus  Pk'''^^^  =    2  (Xitii  +      2    PiT(Xi) 

i=l  i=l 

We  operate  on  this  equation  byJi'  ^Then  since  {ifiii  =  i  is  in  N^.  ^  we  get 

k-l 

PkTi(^)  =     2    PiTi(Xi) 
i=l 

LetVi=   (P,/Pk). 

k-l 

Then  ''''^^"     2   Yi^)  =  C> 

i=l 
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k  - 1 

Thus  Ttjj  -     2    Vj7«i  e     N^ 

i=l 

V 

S1nce{xj}j^j   Is  a  basis  for  P  = ,  and  0  <  k  <  p. 


k  - 1 


Xfc  -     2    ViXi  e     P. 
i  =  i 


k-  1 

Then  x^-     Sy^-xje    Pj^Nj 

i  =  1 


But  P  j  n  N  ^  =  0. 


k  -  1 


Hence  -k^^  -     2    yj>4  = 

i  =  I 


k 

But  this  implies  that  ^l^si  is  a  linearly  dependent  set,  which  is 

p 
impossible  since  for  p  >  k,  {a^}  j,  ^  is  a  linearly  independent  set,  because 

it  is  a  basis  for  P^ . 

By  this  contradiction,  it  follows  that 

y  =  ^Vi'Vz'  -  '  %'  '^('H^'  'J"(x2), ... ,  Kxjj) }  is  linearly  independent. 


Now  since  TMT(Xi)]  =  0,  i=  1,2,  ...,p,  and  7Htfk)  =  0,  k=  1,2,  ...,q,  I)  is 
a  subspace  of  N ^  We  complete  y  to  a  basis  f or  N ^  say 

We  know  that  { tjj,  ij,.     .  HjHs  a  basis  for  N  j .  ^  . 


i-i- 
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Then  since  N^  =  Nj.i  0  P^.^ 

it  follows  that  { Kxj),  TCxj), ... ,  Ti-K^),  x^,  z^, ... ,  2^ }  is  a  basis  for  P ^ .  ^  ■ 

We  now  give  on  example  to  illustrate  the  special  basis  for  the 
Jordan  form  of  a  nilpotent  operator  on  V.  Following  the  example  we  shall 
give  a  detailed  construction  of  this  special  basis. 

Let  T  be  an  operator  on  a  vector  space  V  that  has  the  decomposition 

V=  P3®  P2  ©  Pi  ®  Pq 
where  if  xe  Pj  _  j  and  x*  0,  then 

THx)  =0  but   V-H'k)xO 
Also  it  follows  that  T is  nilpotent  on  V  of  index  4. 

Suppose  that  P3  is  of  dimension  2,  P^  is  of  dimension  3,  Pj  is  of  dimension 
5,  and  P^  is  of  dimension  7. 

Let  {P3}  =  { xj,  X2 }  be  a  basis  for  P.^.  Then  by  the  lemma,  it  follows  that 
{Pg}  =  {  T(xj),  T(x^),  x^  }  will  be  a  basis  for  P^, 
{p^}  =  { J^i-K^),  7^(x2),  Kx^),  -x^,  x^}  will  be  a  basis  for  P^,  and 
{Pq}  =  {  T^(xi).  Pi-K^),  T^(x3),  K^j),  TCx^),  x^,  X7  }  will  be  a  basis  for  Pq. 

By  the  decomposition  of  V  it  follows  that  {P3}  u  {P2}  u  {Pj}  u  {Pq}  is  a 
basis  for  V.  We  write  this  basis  in  the  following  row  and  column  format: 


33c|lf»^l^i« 
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{Pj} 

{P2} 

IP,} 

{Pq} 

*1 

Ttxi) 

t2(xi) 

t3(xi) 

*2 

Kx2) 

T2(x2) 

t3(x2) 

'«^3 

T(x3) 

T2(x3) 

«4 

Kx4) 

^^5 

Ttx5) 
*7 

Let  us  consider  the  operation  of  Ton  the  basis  elements  of  V  in  the 
following  special  order :  read  the  elennents  of  the  basis  from  the  top  across 
each  row  from  right  to  left. 

Then  by  the  definition  of  Pj  and  since  T*  =  0,  the  matrix  representation  of  T 
with  respect  to  the  basis  elements  from  the  first  row  is 


IQ]  = 


0  10    0 

0  0     10 

0  0    0     1 

0  0    0    0 


Similarly,  the  matrix  representation  of  T  with  respect  to  the  basis  elements 
from  the  second  row  is  identical  to  I  Q 1. 

In  a  similar  manner,  the  matrix  representation  of  T  with  respect  to  the 
basis  elements  from  the  third  row  is 


IR1  = 


0    10^ 
0    0    1 
L  0    0    0 


47 


The  matrix  representations  of  T  with  respect  to  the  basis  elements  from  the 
fourth  and  fifth  rows  are  each  of  the  form 


(Sl- 


0    1 
0     0 


And  finally,  the  matrix  representations  of  T  with  respect  to  the  basis 
elements  from  the  sixth  and  seventh  rows  are  each  the  1  x  1  zero  matrix. 

We  now  combine  the  matrices  to  obtain  the  following  Jordan  matrix 
representation  of  our  linear  operator! with  respect  to  the  special  basis 
obtained  above. 


IT]  = 


0  10    0 

0  0     10 

0  0    0     1 

0  0    0    0 


0  10    0 

0  0     10 

0  0    0     1 

0  0    0    0 


0  1  0 
0  0  1 
0    0    0 


0     1 
0    0 


0     1 
0    0 


..-.J  mcr 


48 


Our  example  gives  us  a  visual  idea  of  the  simple  Jordan 
representation  of  a  linear  operator  mhich  is  nilpotent  on  the  vector  space. 
However,  our  object  is  to  give  a  simple  representation  for  any  linear 
operator  on  a  vector  space.  In  order  to  do  so  we  first  describe  the 
construction  of  the  special  basis  illustrated  in  the  example  above  for  an 
arbitrary  nilpotent  operator  V.  We  shall  then  construct  the  Jordan  matrix  of 
any  linear  operator  T  with  respect  to  the  implication  of  Theorem  9,  which 
was  that  U^  is  an  eigenspace  of  V  associated  with  the  eigenvalue  A^,  if  and 

only  if  (T-  AJ)  is  nilpotent  on  Uj. 

Thus  we  return  to  the  decomposition  of  V  into 

V=  Pfc.i®  Pk-2  ®...®  Pi  ®  Po 

and  use  the  lemma  to  construct  the  basis  for  the  Jordan  form  as  follows: 

p 
Let  Uik-i}i  =  i  be  a  basis  for  Pjj.i  such  that 

Then  by  the  lemma,  we  can  complete  the  following  basis  for  P^ .  2  ■ 

9  p  +  q 

We  proceed  by  induction  until  a  basis  for  Pq  has  been  obtained. 

Then  since 

V  =  Pk  - 1  ®  Pk  -  2  ®  ■■  ®  Pi  ®  Po 
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it  follows  that  the  set  consisting  of  the  bases  for  P^,   j  =  0,  1,  2, ... ,  k  -  1  Js 
a  basis  for  V.  Let  {P: }  be  the  basis  for  P^ .  Then  we  can  represent  the  basis 
for  V  under  the  columns  {Pj },  j  =  0,  1 ,  2, ... ,  k  -  1 ,  as  follows: 


(P.-I  } 

iPk-2} 

*l,k-l 

Kxi^k-l) 

*2Jt-l 

■Kx2,k-l) 

{P.- 


{P^} 


T2(x2,k-l)      '^-^(^ZM-O 


fP    ^ 
lk-l(x2,k-i) 


*p,k-l  T^^,,)i-0  T2(xpk-l)       l*"^«p,k-l)  ^'^(^,k-l> 

*p+l,k-2  T^^+l,k-2>     1^'^<;^+l,k-2)  '»^'^(^+l,k-2) 


'S>+q,k-2  'K^p+q.k-a)       '^'^^+q,k-2>  1*"^(«p+q,k-2) 

Xp+q+l-k-3      1^"*(*p+q+l,k-3)        1*'^tV-q+l.k-3^ 


Vq+r,k-3       l*"*<^«p+q+r,k-3^        '»*'^^+q+r,k-3^ 


^+q+r+...+m,l  ^''p+q+r+    +ni'l'' 

'^+q+r+...+m+l,0 


^+q+r+...+m+ii,0 


The  Jordan  form  of  a  matrix  results  from  a  special  ordering  of  the  above 
basis  elements  of  V. 

Consider  the  basis  for  V  as  consisting  of  the  sets  of  t-elements. 


'iJ 


^G!  i. 
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t  =  k,  k  - 1 2..  1 ..  obtained  from  the  bases  {P^ },  {P^ } iP^  .  2),  tPk  - 1  ^ 

as  follows: 

Each  set  will  have  a  t  number  of  basis  elements,  t=  k,  k  -1, ... ,  2,  1,  which 
are  obtained  by  reading  the  entries  in  the  columns  {Pj },  j  =  0,  1,  2, ... ,  k  -  1, 
across  each  row  from  right  to  left. 

For  example,  the  first  p  rows  will  yield  a  p  number  of  sets  with  each  set 
containing  a  k  number  of  basis  elements  of  the  form 

where  each  i,  i=  1,  2, ... ,  p,  corresponds  to  the  specific  row.  Let  tJ^  be  the 
subspace  covered  by  the  complete  basis  { Xj,  K^, ... ,  Xp  }. 

Notice  that  T operating  on  the  basis  Xj,  annihilates  7*  "Kx^jj.  j),  the 
element  from  the  basis  {P^, },  but  T operating  on  7* '  H-x^i^ .  i),  the  element 
from  the  basis  IPj  I,  replaces  the  element  from  {P^, }. 

Similarly,  the  element  from  (Pj }  replaces  that  from  {P^ }  when  operated  on 
by  T.  In  fact,  we  can  represent  the  operation  of  Ton  any  particular  set  of 
basis  elements  'K^,  by  the  following  matrix  : 


::DnOQL-&" 


T 

^ 

^(>ti..k 

-l) 

1* 

^(Xi,k 

-l) 

i^-3<:>ti,k 

-l) 

T2(xi,k-i) 

TCxi^jj-l)  Xi,k-i 

i^'kxi  v  i) 

0 

1 

0 

0 

0           0 

0 

0 

1 

0 

0           0 

l*-^Xi,k-l) 

0 

0 

0 

0 

0           0 

iQil  = 

T2(v;  1,   1 ) 

0 

0 

0 

0 

1            0 

0 

0 

0 

0 

0            1 

0 

0 

0 

0 

0           0 

^1,K-1 

i  =  1 ,  2, ... ,  p.  Observe  that  [  QJ  is  a  k  x  k  matrix. 


Let 


TJ  = 


iQil      0         0 
0       [  Q2]      0 

0  0  [  Q.; 


0         0         0 


V 


where  each  [  QJ ,  i=  1,2,...,  p,  is  the  k  x  k  matrix  obtained  above. 
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LelTj  be  the  reslrlcllon  of  Tto  Uj-Then  I  Til  is  ine  matrix  representation  of 

Ti  with  respect  to  the  basis  { Xj,  X2 X^  }.  It  is  also  the  case  that  Tj  is 

nilpotent  on  Uj  of  index  k. 

Thus  far,  T operating  on  the  basis  elements  from  the  first  p  rows  of 
the  columns  {Pj  }J  =  0,  ],2, ...  ,k-  1,  has  yielded  the  matrix  [  T^l . 

In  a  similar  manner,  we  can  construct  a  matrix  [  T2I,  which 
represents  the  operation  of  Ton  the  next  q  rows  of  the  columns  {Pj }.  Since 
{P^ .  j}  has  no  more  entries,  j  =  0,  1 ,  2, ... ,  k  -  2  .  Thus  each  matrix  [  QJ, 

i  =  1,2 q,  from  which  we  construct  I  Tgl  is  a  (k  -  1)  x  (k  -  1 )  matrix. 

Also  if  U2  is  the  space  spanned  by  the  basis  for  I  Tjl,  and  T2  is  the 
restriction  of  Tg  to  Ug,  then  Tg  is  nilpotent  of  index  k-1  on  U^ . 

Continuing  in  this  manner,  we  will  arrive  at  the  following  matrix 
representation  of  T. 


T]  = 


iTjl  0  0 
0  [T2]  0 
0         0       [  T, 


0  0  0 


ITJ. 


T 1  will  have  zero  entries  everywhere  except  along  the  upper  off  diagonal, 
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where  the  entries  will  be  either  zero  or  one. 

Observe  that  I J^]  will  consist  of  the  zero  matrix,  since  each  matrix  I  0^], 

i=  \,2, ... ,  r\,  will  be  the  1  x  1  zero  matrix  : 


iQil    =      ^i 


i,0 


X 


i,0 


Thus  I  T^]  will  be  the  n  x  n  zero  matrix. 


The  JORDAN  FORM 

When  constructing  the  special  basis  for  a  Jordan  matrix 
representation  of  a  linear  operator  Ton  a  vector  space  V,  we  assumed  that  T 
was  nilpotent  of  index  k  on  V.  We  now  describe  how  to  obtain  a  Jordan 
matrix  representation  for  any  linear  operator  Ton  V.  (Note  that  since  Visa 
complex  finite-dimensional  vector  space,  our  field  is  algebraically  closed). 


Let  V  =  U^  ®  U^  ©  ...  ®  U^  ,  where  U^,  i  =  1 ,  2, ... ,  k,  are  the 
eigenspaces  of  a  vector  space  V  under  any  linear  operator  Ton  '■■/,  and  let  Tj 
be  the  restriction  of  Tto  U^.  Then  from  Theorem  9,  we  know  that  if  A^  is  the 

eigenvalue  associated  with  U^,  (T^  -  A^  1)  is  nilpotent  of  index  r^  on  U^. 

Thus  we  can  construct  a  special  basis  for  the  eigenspace  U^,  such 


10  nof.tt 
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that  the  matrix  representation  of  (T^  -  A^  I)  on  U^  is  in  the  Jordan  form  for  a 
nilpotent  operator,  i=  1,  2, ... ,  k. 

In  other  words,  we  consider  the  following  analogies  between  our 
present  construction  of  a  special  basis  for  V,  where  T  is  any  operator  on  V, 
and  our  former  construction  of  a  special  basis  for  V  where  the  operator! 
was  nilpotent  of  index  k  on  V.  We  treat 

i)  each  eigenspace  [i^  as  analogous  to  the  vector  space  V. 

ii)  each  operator  (Tj  -  A^  r)  as  analogous  to  the  operator!, 
ili)  each  r^  as  analogous  to  k. 

We  examine  the  operation  of  (T^  -  A^  I)  on  U^,  for  1=  1,2, ... ,  k. 

Let  [  Tj  -  Aj  1 1  be  the  Jordan  matrix  representation  of  (T^  -  X^  I)  on 
Uj  with  respect  to  the  special  basis  constructed  for  Uj  (the  construction  is 
similar  to  our  earlier  construction  with  the  analogous  relationships 
decribed  above).  Then  it  follows  that 


Ti-  hi 


T,J  0  0 
0  [J,,]  0 
0    0  [J,,] 


L  0 


iTj 


ii^QLQh 
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where 


ITJ  = 


Qrll 

0 

0 

0 

0 

IQJ 

0 

0 

0 

0 

{^ 

0 

0  0 


IQ. 


The  number  s  indicates  the  number  of  [  Qj-^l's  in  each  ( 1^^],  r  =  1 ,  2, ... ,  m. 
( I  Tij]  corresponds  to  I  Tj,  i  =  1,2, ... ,  j,  in  our  former  construction).  The 
I  Qj.Js  will  be  of  the  following  form: 


V  = 


0     10    0  

0 

0    0     10  

0 

0    0    0     1    

0 

0    0    0    0  1 

0    0    0    0  0 


The  size  of  each  I  Qj.^),  t  =  1,2, ... ,  s,  is  the  same  for  a  given  I  TiJ.  ( [  0^^! 
corresponds  to  [  Qj]  in  our  former  construction,  where  I  Qjl,  i=  1,2, ... ,  p, 
was  a  k  X  k  matrix  for  (  Tj  ). 


We  use  the  following  notation 


®    IT,,]  = 


Til)  0  0 
0  lTi2]  0 
0         0       [T 


13^ 


I  T;^]  , 
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Thus  it  follows  that  I T^  -  Aj  I  ]  =  ®  [  J^^] .  If  I  J^]  is  the  matrix 

I 

representation  of  T^  with  respect  to  the  special  basis  for  U^,  then 
I  TJ  -  Ai  I  =  [  Ti  -  Ai  I  ]  =  ®  I  Ti,l 


Thus  (  TJ  =  Ai  I  +    ©  [  Ti^] 

r 

Substituting  f or  (  J^.^] , 


I  TJ  =    Ai  r  +     © 


1  Qril  0  0 
0  I  Q,.]  0 
0        0      I  0,3] 


_    0  0  0 


Qr.) 


Let 


so  that. 


[  J,J  =  A^  I    +  [  Q,J 


\\,\- 


t=  1,2, 


A^    1     0    0  

0 

0    Ai    1     0  

0 

0    0    A=    1    

0 

0    0    0    0  1 

L  0  0  0  0 \ 


The  size  of  each  (  J^.^,  t  =  1,  2, ... ,  sjs  the  same  for  a  given  [  T-^]. 
The  [  J^J  s  are  called  Jordan  blocks. 


Thus  if  1 1^1  Is  the  matrix  representation  of  T^  on  Uj  with  respect  to  the 
specially  constructed  basis  for  U^, 
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[T,]  = 


[JlJ        0  0 

0        iJj]       0 
0         0       I  Jj] 


LOGO 


NJ_ 


where  each  [  .Ij  is  of  the  form 


J,]  = 


[J^il      0  0 

0        I  J,2]      0 
0  0       I  J.j] 


0  0  0 


NJ- 


for  r=  1,  2, ... ,  m  . 

Observe  that  m  will  Indicate  the  number  of  Jordan  blocks  of  size  s 
corresponding  to  the  eigenvalue  A^. 


We  draw  the  following  conclusions  to  arrive  at  the  Jordan  form  of 
the  linear  operator  T  on  the  vector  space  V  : 
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1)  Since  V  =  Uj  9  U2®  ...  ©  U^..  the  union  of  the  special  bases  for  U^, 
i=  1,2, ... ,  k.  Is  a  basis  for  V.  (It  is  the  special  basis  for  V). 

ii)  Since  T^  is  the  restriction  of  T  to  U^,  1=  \,2,...,k,   we  get 
T=Ti®T2©...®Tj, 
by  the  definition  (p.  13)  of  the  reduction  of  T  by  (Uj,  U2, ... ,  U^). 


Thus  the  matrix  representation  of  T  with  respect  to  the  special  basis  for  V, 
will  be  given  by  [  T  ]  where 


T]  = 


ITJ      0 
0       [T^l 
0         0 


0 
0 

IT3I 


[TJJ 


This  is  a  Jordan  Canonical  Form  of  the  matrix  representation  of  a 
linear  operator  Ton  a  finite-dimensional  vector  space  V,  with  respect  to 
the  special  basis  constructed  for  V  D 


We  emphasize  that  the  matrix  [  T  ]  above  is  not  the  only  Jordan 
form,  but  depends  on  the  order  in  which  the  eigenspaces  of  V  are  chosen. 
However,  it  is  possible  to  determine  the  number  of  Jordan  blocks  of  a  given 
size  in  each  eigenspace  of  V  ^  These  Jordan  blocks  are  unique  toT.  Different 
combinations  of  these  blocks  will  produce  different,  but  equally  valid 
Jordan  representations  of  T. 
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We  write  the  major  result  of  this  chapter  as  the  following  theorem: 

TheoTe-m  10 

Let  T  be  a  linear  operator  on  the  finite-dimensional  vector  space  V 
Whose  characteristic  polynomial  has  dim(V)  roots  (not  necessarily  distinct) 
in  the  field  |F  over  which  V  is  defined.  Then 

i)  There  exists  a  special  basis  for  V  such  that  the  matrix 

representation  of  T has  a  direct-sum  decomposition  into  Jordan 
block  matrices, 
ii)  In  this  decomposition  the  number  of  Jordan  blocks  and  their  sizes 
are  uniquely  determined  by  T  ■ 


Before  concluding,  we  make  the  following  observations  concerning 
the  minimum  and  characteristic  polynomials  of  T.  First,  the  multiplicity  of 
a  root  of  the  minimum  polynomial  (  r^  in  Theorem  9  )  is  equal  to  the  size  of 
the  largest  "Jordan  block"  corresponding  to  that  root.  ( Thus  a  Jordan 
canonical  form  contains  only  one  Jordan  block  for  each  eigenvalue  Aj  if  and 
only  if  the  minimum  polynomial  of  T  is  equal  to  the  characteristic 
polynomial  of  T).  Second,  the  characteristic  and  minimum  polynomials  do 
not  necessarily  determine  a  Jordan  form  of  T. 

We  conclude  our  discussion  of  the  Jordan  Canonical  Form  with  some 
examples  which  illustrate  the  idea  of  the  "Jordan  blocks"  and  their  relation 
to  the  characteristic  and  minimum  polynomials. 


il  I  L';  Dyp 
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fbvO'Tnpfe  1 

Let  c(A)  =  (A-2)3(A-3)2   and  m(r)  =  (  T- 2)2  (  T- 3)  be  the 
characteristic  and  minimum  polynomials  respectively  of  a  linear  operator! 
on  the  vector  space  V.  c(A)  indicates  that  the  diagonal  entries  (eigenvalues) 
are  2,  2,  2,  3,  and  3.  ro(T)  indicates  that  the  size  of  the  largest  Jordan  block 
with  eigenvalue  2  is  2,  and  the  size  of  the  largest  Jordan  block  with 
eigenvalue  3  is  1.  Thus  a  Jordan  form  of  lis 


T]  = 


0    2 


Let  c(A)  =  (  A  -  2)4  (  X  -  i)3  (  A  +  i)  and  c»(7)  =  (T  -  2)2  (T  -  i)^  (T+  i). 
Then  there  are  two  possible  sets  of  Jordan  blocks  in  a  Jordan  form  of  T. 


2     1 
0    2 


T]  = 


2     1 
0    2 


i   1 

0  i 


0    2 


or 


T]  = 


i   1 
0  i 


-  vi 


-  \. 
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!E?tam|3te  3 

Let  T :  IC  9  — >  IC  9  be  the  linear  operator  represented  by  the  Jordan 
form  matrix 


IT]  = 


1-i 

1 

0 

-i 

1-i 

1 

0    1 

-i 

3     1     0 
0    3     1 
0    0    3 

Thenc(A)=(A+  I  -  1)4  ( A  -  3)5   and  m(T)  =  ( T  +  I  -  1)2(7-3)3. 


62 


rtjc  specrRAL  riieDRecn 

f  DR  NDRCDAL  DpeRi\rOR5 

IHTRODUCTION 

The  discussion  of  the  Jordan  form  of  a  linear  operator  indicated  that 
on  a  finite-dimensional  space,  the  spectrum  of  a  linear  operator  consists  of 
its  eigenvalues.  However,  the  Jordan  form  is  a  spectral  theorem  limited  to  a 
finite-dimensional  space  and  does  not  generalize  to  infinite-dimensional 
space. 

In  this  chapter  we  shall  prove  a  spectral  theorem  for  normal 
operators  on  a  finite-dimensional  space.  The  proof  will  be  related  to  our 
discussion  of  the  Jordan  form.  However,  unlike  the  Jordan  form,  the  spectral 
theorem  for  normal  operators  does  generalize  to  infinite-dimensional  space. 


".-r^rr/^^    r-  ,..arD30^      --S^' 
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The  basic  definitions  and  theorems 

The  following  concepts  and  related  theorems  are  necessary  for  our 
discussion.  We  do  not  discuss  or  provo  them  in  detail  as  our  aim  is  to  relate 
the  spectral  theorem  for  normal  operators  to  our  discussion  of  the  Jordan 
form. 

An  inner  product  in  a  complex  (real)  vector  space  H  is  a  complex  (real) 
valued  function,  denoted  ( , )  whose  domain  is  H  x  H  such  that 


i)    (x,tj)  =  (ij,  k)  where  (t|,x)  denotes  the 

complex  conjugate  of  (y ,  x) 
ii)    ((XjXj  +  a2X2  ,  y)  =  aj(xj  ,  t|)  +  (X2(x2  ,  y) 

and  for  any  complex  (real)  ccj  ,  aj , 

iii)  (x,x)>0  and  (x,x)  =  0  iff  x=  0 

An  inner-product  space  is  a  vector  space  equipped  with  an  inner  product.  A 
real  inner-product  space  is  a  Euclidean  space.  If  the  scalar  field  is 
complex,  then  an  inner-product  space  is  called  a  unitary  space. 

T*  is  an  adjoint  of  a  linear  operator  T  on  an  inner-product  space  H,  if  T*  is 
an  operator  on  H  such  that  (T(x) ,  y)  =  (x ,  T*(t|)),  for  all  x ,  y  e  H. 

Tis  said  to  be  a  self-adjoint  operator  (or  Hermitian)  if  T=  T*. 

An  operator  U on  a  unitary  space  is  a  unitary  operator  iff  U*  =  U"'- . 


'Atil 


:9n." 
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If  H  is  an  Inner-product  space  and  U  is  a  subspace  of  H,  then 

U  ■•■  =  {  y  :  y  G  H,  (x ,  t|)  =  0  f  or  any  x  G  U  } 
is  a  subspace  of  H  and  U  ■••  is  called  the  orthogonal  complement  of  U. 

A  projection  £  on  U  along  U  •■•  is  called  the  orthogonal  projection  on  U. 

II E 11  is  the  number  by  which  £  multiplies  the  length  of  a  vector. 

Tnccmciii  1 

An  operator  Eon  the  inner-product  space  H  is  an  orthogonal 
projection  iff  E=  E^  =  £*  if  E  is  a  nonzero  orthogonal  projection,  then 
liE||=  !■ 

An  operator  Ton  the  inner-product  space  H  is  said  to  be  a  normal  operator 
if  and  only  if  77*  =  T*T.  (Both  self -ad  joint  and  unitary  operators  are  normal 
operators  since  they  both  commute  with  their  adjoint). 

Theoretn  2 

If  Tis  a  normal  operator  on  an  inner-product  space  H,  then  xis  an 
eigenvector  of  T corresponding  to  the  eigenvalue  A   if  and  only  if  x.  is  an 
eigenvector  of  T*  corresponding  to  the  eigenvalue  X  ■ 

Tricoreiii  S 

It  follows  from  the  above  theorem  that  if  xis  in  the  null  space  of  T, 
then  X  is  in  the  null  space  of  T*  ■ 


..-n- 


rtrrfOorTl 
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The  spectral  theorem  for  normal  operators 

There  are  several  possible  proofs  of  the  spectral  theorem  for 
normal  operators  using  the  properties  of  orthogonal  projections.  However, 
as  mentioned  at  the  outset,  the  proof  we  present  is  related  to  the  proof  of 
the  existence  of  a  Jordan  form  for  linear  operators  on  a  finite-dimensional 
space.  The  generalization  to  infinite-dimensions  requires  different 
techniques. 

TFi€»rem4 

Let  T  be  a  normal  operator  on  the  finite-dimensional  inner-product 
space  H.  If  A^,  A2, ... ,  A,,,  are  the  distinct  eigenvalues  of  T,  then  there  exist 
orthogonal  projections  Ej,  ^^2'  -  >  ^^  such  that  E^  is  a  projection  on  the 
eigenspace  corresponding  toA^,  i=  1,  2, ... ,  k  . 

Furthermore, 

k 
1)    T  =     2    A^Ei 

k 

11)  2   E^  =  r 

i  =  l 

ill)    E^Ej  =  0,  i;*j 

Proof 

Let  m(t)  =  (t  -  Aj)  (t  -  A2) ...  (t  -  \),  correspond  to  m(T),  the 
minimum  polynomial  of  T. 
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If  k  <  2,  then  either  m(T)  is  of  the  form  T  +  ccl  =  O,  or  T  =  0.  In  either  case 
the  proof  of  the  theorem  is  trivial.  We  prove  that  the  theorem  holds  true  for 
k  >2. 


Define  p^(t)  by 


k 

p.(t)=      TT    (t  -  h) 


j*i 


Then 


pj(t)=        (t  -  A,)  (t  -  A3)         (t  -  A,,) 
(  Aj  -  A2)  (  Ai  -  A,,)  ...    (  Ai  -  Aj,) 


P2(t)=        (t  -  A,)  (t  -  A-j)    ...    (t  -  A,) 


Thus  p^(t)  has  degree  k  -  1   for  all  i=  1,  2, ....  k. 


k 


Let  p(t)=    2    Pi(t) 


i=  1 


Then  p(t)  has  degree  k  -  1 . 

Notice  that  pi(Ai)=  I,  but  P2(Ai)=  P3(Ai)=  ...  =pjj(Ai)  =  0. 

Also  P2tA2^=  ^'    ^^^   Pl^^2^=  P3^^2^=     ■   =Pk^^2^=^ 

and  in  general,  p^CAp  =  S^ . 


i/^q 
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Suppose  s(t)  is  a  polynomial  of  degree  k  -  1   or  less.  Then  we  claim  that 
s(t)  can  be  expressed  as 

k 

sit)  =    2   s(Ai)pi(t) 
i=  1 

This  Is  because 

k 

s(Ap-    1  s(Ai)pi(Aj)=  s(  Aj)  -  s(  Aj)  Pj(Aj)  =  s(  Aj)  -  s(  Aj)  =  0 
i=l 

since pj(Aj)  =  5^^  for  j  =  ],2, ... ,  k. 

k 

Then  s(t)-    1  s(App^(t)  is  a  polynomial  of  degree  <  k-  1   withk 

distinct  zeros  (t=  Aj,  Aj, ... ,  Aj,).  Thus  the  polynorniai  must  be  zero.  We 
consider  two  possibilities  for  s(t) ; 


k 

Case  1  ;  Let  sit)  =  1 .  Then  s(  A^  =  1 .  Thus     2  ip^it)  =  1 

i=  1 


k 

Case  2  :  Let  s(t)  =  t .  Then  s(  A^)  =  A^.  Thus     1   A^  p^Ct)  =  t 

i  =  l 


Also  observe  that  for  ix] , 

k  k 

Pi(t)p.(t)=    TT  JLjlAL  TT  JLjJil 

j  =  1     (  Ai  -  Aj)      i  =  1    (  Aj  -  A^) 


■t.'Z 


t  =  t 
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Therefore  p^Ct)  Pj(t)  =  rod)  q(t) ,  for  i  ^  j ,  where  q(t)  is  a  polynomial  in  t 
Then  since  ro(t)  =  0, 

Pi(t)  p:(t)  =0  f  or  i  ;i  j 


Thus  we  have 

k 

i)  2  Pi(t)=  1 

i=l 

k 

ii)  1   AiPi(t)  =  t 

i  =  l 

iii)         Pi(t)  p^(t)  =0  for  i  *  j 

Now  the  set  of  all  polynomials  in  t  over  the  scalar  field  is  a  ring,  say  F(t). 
Similarly,  the  set  of  all  polynomials  in  T  over  the  scalar  field  is  a  ring,  say 
F(T).  There  is  thus  an  isomorphic  mapping  from  F(t)  to  F(T)  which  preserves 
polynomial  identities. 

We  can  therefore  rewrite  the  results  obtained  above  as. 


k 

1)        I  Pim=i 

i  =  l 

k 

ii)  2   AiPi(T)=T 

i  =  l 

iii)  Pj(T)p/T)=0  for  isj 


no 


■J    -   [i: 
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We  let  E:  =  p:(T)    j  =  1,2 k  .  Then  it  follows  that  the  three  conditions 


k 

i)   T=    I   A^^i 

i=l 
k 

11)  2   E-i  =  r 

i  =  l 


111)    EjEj  =  0,  for  i*j 

are  satisfied.  To  complete  the  proof,  we  must  show  that  £=  =  p:(T)  is  an 
orthogonal  projection  on  the  eigenspace  of  X: ,  for  j  =  \,2, ...  ,k  . 

k 

Now  r  =    2    Ei 

i=l 


Then 


Ej   =   2    EjEj  =  E^2        (since  E^E- 0,  ijij  ) 


i  =  l 


Therefore  E^  is  a  projection,  j  =  1 ,  2, ... ,  k  . 

Let  xe  H.  Then 

E.(x.-EjW)  =  Ej(x)-Ej.2(x,)  »  Ej(x)-  E^(x)  -  0 
Thus  X.  G  N  E  j . 
Then  from  Theorem  3,  xe  N^j*. 

Therefore  E^*(x- E^(x))  =  0 

or  Ej*(x)-Ej*Ej(x)  =  0  forallxeH. 
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Then  tj*  =  Ej*Ej.Thus 

Therefore  E^  is  an  orthogonal  projection  for  each  j  =  ],2, ...  ,k  . 
Finally,  we  need  to  prove  that  E^  projects  onto  the  eigenspace  of  A; 
Suppose  X  is  an  eigenvector  of  T  corresponding  to  the  eigenvalue  A; .  Then 


k 

2 

i  =  l 


since     2    A^E^  =    T, 


2    AjE^(x)  =    T(x)  =  A:X 
i  =  l 


k 

Also  since  I  =    2    E^ 

i  =  l 


k 

X  =    2    Ei(x) 
i  =  l 


k  k 

Thus  2    AiEi(x)  =    A^    2     E^Cx) 

i=l  i=l 


Therefore 


k 

(Ai  -    A.p  Ei(x)  =  0 


i  =  l 


k 
Then  II    2  (A^  -    Aj)  E^Cx)  ||2  =  o 

i=  1 


IKAj-  A^E i(x)  +  (A2-  A^E  2(x)  +  ...  +  (A-  ApE j(x)  +  ...  +  (Aj^-  A^E jj(x)  II  ^  =  0 
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Then  since  '£i"E^=  0,  for  i^j, 

k 

2  (Ai  -    Ap2||E.(^)||2^  0 


1 

k 


i  =  l 


But  for  the  sum  of  non-negative  quantities  to  be  zero,  each  summand  must 
be  zero. 

Thus  for  ix\,  EjW  =  0 

k 

Then  since  x  =    I  E^W, 


i=l 


E:(X)      =     7C 


On  the  other  hand,  if  E^W  =  x,  then  T(x)  =  T£j(x.).  Also  since 
E  =  p  (T)  is  a  polynomial  in  TJt  commutes  with  T. 

k 
Thus  T(x)  =  T£j(x)=  EjT(x)  =  Ej  (   2    AiEi(x)) 

i  =  1 

=  A^EjEj(x)  (Ej£i  =  0,  i^j) 

=  A^Ej(x)  (Ej(x)=x) 

.-.  T(x)  =  AjX 

Therefore  X  is  an  eigenvector  corresponding  to  the  eigenvalue  A| , 
and  the  range  of  E^  is  the  set  of  eigenvectors  of  T corresponding  to  A:  ■ 
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Condusion 

Quantum  mechanics  is  one  area  in  modern  physics  where  the 
mathematical  theory  of  linear  algebra  and  inner  product  spaces  is  used. 
Damiano  and  Little  ^  write  that 


In  the  nineteenth  century  it  was  discovered  that  vhen  atoms  of  a  substance  (e.g.,  gases 
such  as  hydrogen)  are  excited,  they  give  off  light  of  certain  precisely  defined  wavelengths 
(colors).  This  is  v/hat  happens,  for  example,  in  "neon"  signs.  An  electric  current  is  passed 
through  a  glass  tube  containing  a  gas.  The  excited  atoms  of  the  gas  give  off  light  of  the  desired 
color.  In  fact,  the  wavelengths  (or  "spectral  lines")  of  the  light  emitted  by  a  glowing  object  are 
so  characteristic  of  the  elements  present  that  they  can  be  used  to  determine  the  composition  of 
the  object.  There  was  no  systematic  explanation  for  this  behavior  available  at  the  time  it  was 
first  noticed,  however. 

Toward  the  end  of  the  nineteenth  century ,  mathematicians  studying  analogs  of  our 
symmetric  linear  mappings  on  function  spaces  noted  a  similarity  between  the  discrete  spectral 
lines  of  atoms  and  the  pattern  distribution  of  eigenvalues  of  these  linear  mappings.  Perhaps 
motivated  by  this  analogy,  the  German  mathematician  Hilbert,  who  proved  the  first  general 
version  of  the  theorem  in  question  (but  in  the  function  space  setup),  called  his  result  the 
"spectral  theorem." 

In  the  1920s  and  1930s  the  new  physical  theory  of  quantum  mechanics  was  developed  to 
explain  phenomena  such  is  the  spectral  emission  lines  mentioned  before,  and  in  a  rather 
amazing  vindication  of  the  earlier  mathematicians'  intuition,  it  was  found  that  the  wavelengths 
of  the  emission  spectrum  of  an  atom  were  indeed  related  to  the  eigenvalues  of  a  certain  linear 
operator .  This  was  the  Schrodinger  operator  that  appears  in  the  basic  differential  equation  of 
quantum  mechanics.  pp  206  -  207 


The  concept  of  a  spectral  theorem  for  a  given  operator  is  thus  applicable  to 
the  study  of  external  phenomena. 
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NDrcs 

'  In  his  Linear  AigePra  (New  York  :  Harcourt  Brace.  1976).  nicnaei  O'Nan 
gives  the  following  formula  for  determining  the  exact  numbers  and  sizes 
of  Jordan  tJlocks  for  a  given  linear  operator. 

Let  Tbe  an  operator  on  the  finite-dimensional  vector  space  V  and  A  be 
an  eigenvalue  of  T.  Then  in  the  Jordan  normal  form  of  T,  the  number  of 
Jordan  blocks  of  size  k  and  diagonal  entry  A  is 

r(lT-AI]i'-i)  -  2r([T-Ar]M  +  r  ( [  T  -  AI  jJ'*!) 

p.315 
N.B.  r(  IT])  is  the  rank  of  IT]. 

2  A  Course  in  Linear  Algebra.  David  B.  Damiano  and  John  B.  Little, 
(New  York  :  Harcourt  Brace,  1988). 


23:T0k 
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